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1. INTRODUCTION 

Turbo code as presented by Berrou and al [1] was the first error correcting code to closely approach 
the channel capacity. However, like other Error correcting codes they improve the reliability of data 
transmission at the expense of bandwidth expansion. The redundancy increases the number of bits within the 
transmitted symbol, which can lead to a reduction of information transmission rate or to an increase of the 
bandwidth. Trellis coded modulation (TCM) [2] is a bandwidth efficient coding techniques that integrates a 
convolutional code with a bandwidth-efficient modulation scheme. 

Robertson and Wo6rz in 1995 [3] merge TCM and Turbo codes together in order to benefit from their 
both important structures properties and advantages, and proposed the “Turbo Trellis Coded Modulation” 
(TTCM). The encoder structure of the TTCM is made up of two identical TCM encoders in a parallel 
concatenation linked by a symbol interleaver. The coded symbols of each component encoder are 
alternatively punctured in order to increase the bandwidth efficiency. The decoding of TTCM is done 
iteratively using a symbol-by-symbol Maximum A Posteriori (MAP) component decoders. Derived from the 
TTCM but without punctuation, the Unpunctured Turbo Trellis Coded Modulation (UTTCM) [4], [5] is a 
more recent coded modulation technique, which transmits together: the input information bits and the 2 parity 
check bits from the two component coders in the same codeword. 

Extrinsic Information Transfer (EXIT) chart [6] is powerful tool for analyzing the convergence 
properties of iterative decoding. EXIT chart was originally developed for concatenated binary coding 
schemes and expanded later to non-binary coding schemes [7], [8]. Based on the approach presented in [8], 
the purpose of this paper is to apply the EXIT chart to analyze the performance of the UTTCM. The rest of 
the paper is organized as follows: Section II describes the UTTCM, Section III presents the non-binary 
extrinsic information transfer characteristics. Simulation results and interpretations are presented in 
Section IV. The conclusion is reported in Section V. 
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2. UNPUNCTURED TRELLIS-CODED MODULATION 

The UTTCM turbo encoder as shown in Figure 1, as presented in [4], is a parallel concatenation of 
tow m/m+1 rate RSC (Recursive Systematic Convolution) encoders separated by an interleaver which can 
be an S-random interleaver or a pseudorandom interleaver [9]. Each RSC produces one parity bit for each m 
systematic bits. The mapper takes the m systematic bits, one parity bit from the upper encoder and the 
deinterleaved parity bit from the bottom encoder and maps them to 2”"*? constellation points. 

Two mapping techniques were proposed. When the first mapping technique adopts Gray mapping, 
the second combines both natural mapping and Gray mapping, it is called Ungerboeck-Gray mapping [5] and 
it show good performances also when used in TCM, as shown in Figure 2 [10]. 


Input symbol 
m bits{ : 









output 


Figure |. Structure of the unpunctured turbo trellis-coded modulation encoder [4] 


Received noisy sym bols 





Figure 2. Decoding scheme of the unpunctured turbo trellis-coded modulation [4] 


The structure of UTTCM receiver is similar to that of TTCM; both are serial concatenation of two 
constituent symbol-by-symbol MAP decoders [4] The objective of the decoder is to determine the A 
Posteriori Probabilities (APP) of the transmitted symbols over an iterative decoding process. The combined 
extrinsic and systematic information (Legs) is extracted from the output of one decoder and passed to the 
second decoder as a priori information (La) in order to improve the reliability of the second decoder’s output 
and vice versa. In this iterative decoding process, the apriori information is always available for the 
constituent decoders except for the first decoding stage were the only information available is that the 
probability of occurrence of one of the 2™ combinations of the encoded symbol is equiprobable. Thus, the 
apriori information will be initialized with [5]: 


Pr(d, =i) = (2) () 


2 


After a few iterations, a decision is conducted on the final APP to evaluate the symbol that was 
received. 
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At each time k (k= 1, 2, ... ,L); the MAP decoder computes the A Posteriori Probability Ax; that the 
information symbol dk was i (i= 0, 1,..., 2") given the received sequence y and select the symbol with the 


largest APP. Thus, each decoder computes 


Pr{dy = ily} = conse D. Ds1 Vi Ye 8,8")- @e-1(S")-Be(S) (2) 


Where, the term (const) is a constant and it is canceled out by the normalization of (2) over all 1 to unity, 
S, = $ is the present state of the encoder trellis and S,_; = s’ is the previous state 
a,(s") is the forward metrics computed as 


a,(s) = Dail i Nils, s'). @p-1(S’) (3) 
with the initial condition 


Q@o(s) = 0 for all s40 (4) 


B;,(s) is the backward metrics computed as 


Br-1(S) = Mast Ve (S, 8"). Be(s’) (5) 
with the initial condition 

Bby(O) =1 

By(s) = 0 for all M40 (6) 


Yx(Yx. S, 8’) is the branch transition metrics given by [5] 


Ven 88") = POKIde = i, Se = S,Sp-1 = 5"). 
q(dy = i|Sy = 8, Sp = 8"). Pr (Sy = 8, Sy-1 = 8‘) (7) 


The term q(d, = i]S, = s,S,-,; = 8s’) is equal to zero or one, depending on whether the input 
symbol d;, = i induces a transition from state s’ to s or not and Pr(S, = s,S,_; = 8’) is set to the a priori 
probability of that symbol. 

In the first term of (7), y, is the noisy version of the transmitted symbol constituted from m 
systematic bits, the parity bit generated by the one encoder and parity bit generated by the other encoder. 

If cf? € {0, 1} is the other encoder parity bit generated at step k, the probability 
ply, ld, = i, S, = $,Sp_1 = 8’) is set to 


PUVcl de = UL Sy = S,Sp-1 = S') = >» PD Ver Ck = jld, = i, Sy =S,S%-1 = 5') = 


Je{0,1} 
1 : ; ; 
5 dje(o1} PVA = b Sk = 8, Sk-1 = 8 Ce =f) (8) 
where it is assumed that 
. : : . 1 
p(ck = jldy = i, SK = S,Sx-1 = 8’) = p(ck =f) = 5 (9) 


2 


ie.: the value of c? is statistically independent of dx, s, and s,_ and can take either zero or one. 
As in the case of TTCM the decoding algorithm can operate in the logarithmic domain and the Log- 
MAP decoder is used or its improved algorithm [11], [12] 


3. CONVERGENCE PREDICTION USING EXIT CHART 

In an iterative decoding process, based on SISO decoders, the extrinsic information generated at the 
output of each decoder is passed to the input of the other one as apriori information. Over iterations, the 
extrinsic information at the input of the decoder enhances the knowledge about the transmitted symbols. To 
quantify the information that tells the extrinsic information about the transmitted symbols, the mutual 
information is used. Therefore for the decoding process to converge there must be an increase in mutual 
information across iterations. Thus, the mutual information “I;” computed for the extrinsic information at the 
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output of each component decoder must be greater than the mutual information “I,” computed for the apriori 
information at its input. 

Ten Brink [6] proposed to track the evolution of the extrinsic mutual information for an iterative 
decoding process on a single component decoder by substituting the apriori information -which should be 
produced at the output of the other decoder- by a vector generated based on a fixed apriori mutual 
information “I,” and to compute mutual information “Ig” of the extrinsic information generated at its output. 
This operation is repeated for different values of “I,”. The resulting “Ir” values are represented as a function 
of “I,” on a curve called the extrinsic information transfer characteristic. In order to flow the exchange of 
extrinsic information in an iterative decoding process, both decoder characteristics are plotted into a single 
diagram in which the axes of the transfer characteristics of the second decoder are swapped. The resulting 
diagram is the Extrinsic Information Transfer (EXIT) chart. 


3.1. Exit chart for UTTCM 

In the case of the UTTCM we follow the method describe in [13] to generate the vector of the 
apriori symbol probabilities. 

Assuming that the binary bits constituting each transmitted symbol are mutually independent, the a 
priori symbol probabilities are generated via the observation of the information symbol over a 
multidimensional Gaussian channel. Namely, every bit from each symbol is BPSK modulated and then 
transmitted through an independent AWGN channel. So the a priori probability of each bit within each 
symbol is generated as for the binary case according to [6], then the obtained log-likelihood values are 
converted to symbol probability, according to: 


eo iti 





P(d = (by, bo,» Bm)) = Tihs (10) 


1te"s 

Where d is the encoded symbol formed from the m information bits b;. L; is the apriori log- 
likelihood values of the bit bj 

The extrinsic probabilities must be evaluated at the output of the decoder. But, in the case of the 
UTTCM the systematic bits and the two parity bits are jointly transmitted through the channel, thus the 
extrinsic and the systematic information cannot be separated [3]. However, in [7] it is assumed that like the 
case of the binary turbo coding, the systematic information represents the information relative to the channel 
observation of the systematic bits. Therefore, it can be evaluated and subtracted along with the apriori 
information from the a posteriori symbol probability at the output of the decoder to compute the extrinsic 
part. 

Yet, in our case the channel observation is associated also with the two parity bits. 

So, supposing that the transmitted data symbols are equally likely, the systematic information about 
2m 4 


the symbol d;, given by [7] {P(d, = ily,)}{9 °. is computed as 
{P(dx = ilyx)} = Mik Lez=0 P(el Sx = map (dy = i. cg. c)). (11) 


Where s;, is the codeword and cj, cz are the two parity bits. 
The corresponding average extrinsic mutual information will be calculated as [8]: 


Ig(d) =m +2Yb_, E [D257 ep (di?) 10g: (en(dt”))| (12) 


Where ep(.) is the extrinsic probability and E[.] is the expectation, which can be approximated by 
simple time-averaging of the extrinsic probabilities of the information symbol. 
Equation (12) is also used to calculate the average a priori information I, (d). 


4. RESULTS AND ANALYSIS 

In this section, the exit chart is used to investigate the performance of UTTCM over AWGN channel 
for 2 and 3 bps spectral efficiencies. The main advantage of the Exit chart is that the analysis is performed on 
a single decoder. No BER simulation of the iterative decoding scheme itself is required. However, this 
simulation is carried out for each case in order to verify the accuracy of the exit chart to predict the E,/No 
convergence threshold. Figure 4 shows the resultant EXIT charts computed for 2 bps UTTCM system for 
various E,/No values. The UTTCM encoder is made up of two identical 8-state rate 2/3 recursive systematic 
convolution code using (13, 11, 05) [5] as generator polynomials, a block length of 16384 symbols and 16- 
QAM constellations with Gray mapping. At the receiver side, a symbol-by-symbol log-MAP decoding 
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algorithm is used. From this figure it can be seen that for Ep/No = 5.4 dB, the two extrinsic information 
transfer characteristic of the two decoders intersect early. From this point of intersection, the mutual 
information at the output of both decoders will be poorer then the mutual information at their input, meaning 
that, after some iteration the decoder was no more able to produce extrinsic information with enhanced 
information on the transmitted bits. Therefore the iterative process will be unable to converge whatever is the 
number of iterations. For E,/No = 5.6 dB the two curves have just avoided the intersection before reaching the 
point (1,1), meaning that, for this E,/No and above the decoder produce an increased extrinsic information 
and thus the iterative process will converge to correct transmitted sequence with high probability. Hence, the 
convergence threshold is approximately 5.6 dB. However, it can be clearly seen that the convergence 
threshold in BER curve of the Figure 3. is at E,/No = 6 dB. Meaning that, there is a deference of 0.4 dB 
between the two results, which could be explain by the limit validity of the assumption that extrinsic 
information and the systematic information can be separated [8]. 
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Figure 3. Bit error rate (BER) curves for UTTCM Figure 4. EXIT charts for UTTCM system (2 bps 
system (2 bps with 16-QAM a block length of 16384 — with 16-QAM and block length of 16384 symbols) 
symbols) at different decoding iterations at various E>/No values 


In Figure 6, the resultant EXIT charts computed for 3 bps UTTCM is depicted. The encoder is made 
up of two identical 8-state rate 3/4 recursive systematic convolution code using (13, 11, 05, 13) [5] as 
generator polynomials, 32-QAM constellations with Gray mapping, an interleaver length of 16384 symbols 
and a log-MAP decoder at the receiver side. The convergence is achieved for E,/No = 10.4 dB, with a 0.2 dB 
mismatch from the convergence threshold in BER curve of Figure 5, which may be again related to the 
assumption that extrinsic information and the systematic information can be separated [8]. 
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5. CONCLUSION 

In this paper, the convergence behavior of iterative decoder of the Unpunctured Turbo Trellis Coded 
Modulation (UTTCM) using the non-binary EXIT chart was investigated. The accuracy of the exit chart to 
predict the decoding convergence threshold has been verified through examples. The results were compared 
to those of BER curve and have shown a slight mismatch, which is explained by the limited validity of the 
independence of the extrinsic information of each UTTCM emitted symbol from its systematic information. 
Nevertheless, the relatively less complicated method of generation makes the EXIT chart a more competitive 
technique for the comparison of different schemes as well as for the search of new designs. 
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